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This interim evaluation of the Missouri Environmental 
Studies Approach (MESA) for the period July 1972-June 1973 measured 
attainment of three objectives, which state that (a) participating 
teachers will use Environmental Studies (ES) materials in their 
teaching as a result of two intensive workshops during the summer of 
1972; (b) the teacher's role will change so that students will take 
more responsibility for learning, and the teacher will tend to use 
the open classroom approach; and (c) students will learn to us.^ the 
total environment as resource material. The first objective, whic^ 
was measured by the number of assignments teachers gave directly 
from, or modeled on, ES materials, was attained. The s-^cond abjective 
was evaluated by an outside consultant who reported that teachers' 
roles had indeed changed as a result of implementation of the 
Environmental Studies Approach. The third objective was measured by 
two tests: the "About Me Test" and the "Positive-Negative Adjective 
List." The results of both of these tests showed that children's 
self*concept and self-esteem were improved. A national evaluatgr .of 
the ES approach commented that MESA project results were more 
pronounced than the national results which showed that (a.) students 
using ES learned more content pertaining to environment than ccntrol 
students and (b) ES materials fostered more decision making on the 
part of both students and teachers and helped to improve students' 
self-image. (HMD) 
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INTHIUM nvALUAriON SUMMARY 
or MISSOUUl HNVIKONMliNTAL STUDHIS APPROACH (MHSA PROJECT) 
lis HA TITLP. I 1 r (PL 89-10) 



Altoiiipts to evaluate projects U'liich are primarily directed at 
altering affective areas, of necessity, are dealing with relatively 
i 1 1-de fined ins t ruiiicnts. 

'J'lic various instruments which have been used by the national 
program were adopted. These instruments and their intended purpose/ 
clientele are: 

A. Classroom Practices Inventory . This instrument 
was developed by the i-S staff in order to attempt 
to get a measure on the classroom practices that 
are consistent with openness in the classroom. 
The instrument is administered to the teacher. 

B. Seating Chart Inventory . This instrument is based 
on work done by Fred C. Feitler of the Southern 
Tier Regional Education Center. The purpose of 
this measurement is to examine the relationships 
b'^tween inter-personal needs and the physical 
setting of the classroom based upon five assumptions. 
The instrument is administered to the teacher. 

C. Classroom Assessment Charts . This is an instrument 
that is based on work done by Anne M. Bubis and 
Edward A. Chittenden at the Education De^^elopment 
Center along with JITS (Educational Testing Service). 
It is reported in ETS publication PR-70-13 "Analysis 
of an Approach to Open Education." In essence it is 
an attempt to determine who contributes to the 
decisions of the classroom. If "ES" materials do 
dev^elop "open^' sorts of classroom practices then the 
locus of control of classroom decisions should shift 
through the year as indicated on this instrument. 
The instrument is administered to both the teacher 
and the students. 

D. 1 :S Ou t c ones — h\o n t h 1 \' R cpo r t . The items on this 
instrumcMit will come directly from the MESA teachers. 
The teachers will be recording those types of 
acti^'ities which they ha-^c found j)ar ticipa ting in the 
MESA program. This instrument was to ha^'e been 

c on j ) I o t e d by t he t c n c 1 1 e r . 



H. About. Mr ^I'ost . This is a solf-concopt tost deutiioped 
by Jaiuos Parker of ilcorj^iia Southern Coiie{J5e. Of 
aboul 10 such instrumnits that the ES staff seriously 
considered usini;-, this lest was received best by 
students in a pre-use i rial of the instruments. This 
instrument is adiiiiais tered to the student. 

F. Pos I tl ^-e-N'Cj^n t i up Ad. !(>(•: f i <a? L is t . There is, of course, 
a lot of research ou the notion of self-description 
as a means of measuring completed by both the students 
and the teacher. 

These instruments ha^-e unusual formats; in particular ^'C" which 
requires distribution of points on a rectangular coordinant display. In 
order to familiarize them with these devices, the teacher- (participants) 
were required to complete these same instruments several times. This 
familiarization was particularly essential since the teachers would be 
administering se^^eral of these items to their students throughout the 
year. 

A number of consultations were held with the national En\/ironinental 
Studies staff at Boulder, Colorado. Mr. Robert Lepper, who has been 
responsible for the present statistical analysis, gave several suggestions 
to the MESA staff. 

The several modifications, deletions, and additions implemented in 
accord with Mr. Lepper^s reactions are: 

1. D. Monthly Tally Sheet was deleted in favor of a 

locally prepared simplified check sheet. 

2. Children who could not read were instructed to draw 
pic cures of themsel'^es in relation to the school 
(the intent being to identify changes in children's 
perception of themsel^^es and growth of their self- 
concept). 

3. Questionnaires-Sur^.-eys v/ere de^reloped by modifying 
a Jefferson County , Colorado, Evaluation Instrument 
for the Open Li^/iru; School (1971). These instruments 
were ; 

Parent a I Out-s t i onnai re 
Admini s trativc Questionnaire 
S 1 1 1 c I ( ■ n I < ,M I t\s t i o ri n a i. r o 

Teaciier Questi onnaire 



Uacli of these instruments were intended to determine the deL',ree 
of open ulassroom procedures generally and the growth of realistic 
positiwo self-concepts by both teaeiiers and students. It was further 
assured that the use of the questionnaires would serue to inform 
administrators as well as parents of the structure and operation of 
tlie l'n\aroiiinental Studies materials. 

Sununarization materials were in the form of (a) a general check 
list of £S activities used and (b) a check-list form to report 
individual teacher innovations. A teacher journal also served to record 
implementation. 

In an attempt to accertain those factors which facilitated or 
which inhibited implementations a final MESA evaluation was completed 
by each participant. 

AN EVALUATION OF EVALUATION 

Generally speaking instruments A, B, C, D, and E were judged to 
be satisfactory although in need of minor modification for computer 
processing. The student drawing as a substitute seems acceptable. The 
check-list forms and MESA final e\^aluation materials were Quite helpful. 
However, the questionnaires unfortunately revealed poor communication 
within the school and parental community. 

It appeared that identification of specific ES activities and, in 
fact, general school experiences are not conuminicated to parents — this 
may well be the normal behavior. Additionally, certain administrators 
appeared reluctant to communicate to parents \da the parental questionnaire' 
the reasons for this reluctance would be pure speculation on the part of 
the writer. 

As a result of this first year evaluation attempts, future study will 
be modified primarily by elimination of the questionnaires. 



D ISSiiMhVATlOiV 

Tlie clissi.'mi.niitioa of informatiun re^^iirdin^ the MT.SA l'rp)i\-t v.j ^ in 
the following forms: 1) the mniliiig of two iiewsl i^l Lers Lo all .^i^-.i 
superintendents of northeast Missouri, 2) distribution uf the urwr; 1 r t Le rs 
to all teachers in the school systems v;hich were a pari of llir Ml S.\ 
Project, 3) placing ot pictures with the news item in newsp;ipiu*s the 
participants^ local newspaper, 4) inner-classroom visitation hotwon the 
MESA teachers and the non-participating teachers, and 5) staff cummunicalion 
as follows: 

a. 3 conference presentations were made outside of the 
state with the contact of 260 indi^-iduais 

b* 4 conference presentations were made by staff members 
within the state with the contact of 245 indiwiduals 

c. the staff made presentations to S local teacher groups 
with an attendance of 304 individuals 

d. the staff made presentations to 7 comr3:unity groups 
within nortlieast Missouri with an attendance of 430 
indi^'iduals 

e. 12 student groups were contacted in northeast Missouri 
with a contact of 360 individuals 

The ef f ecti\/encss of the dissemination becomes most apparant from the 

follov/ing: 1) As staff worked with the teachers during the second summer 

it was quite noticeable that the attitude of these teacliers toward ]:nviron- 

montal Studies had progressed from the beginning attitude of tlic teacliers 

during the first sunnuer operations- During tlie second year's e^'aluation 

we should be able to detect through the pre- test of the diffei.n^it groups 

as to wh^'tlior Lliere is any significant difference- 2) A number of teachers 

arid adiuiiiistrators from schools of northeast Missouri wlio were not 

participating in the MP.SA Project ha^/e inquired as to how they might 

bccoiuo iU'-ul^Mjd and be a part of next yearns jn'Ogram. 
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s. [■.VALUATIOM SUMMAIIY Ol- T!in I-IRST YP.AR 
This c^'aluation sumuuiry is of the first year of a tliree-year 
program which operated during the fiscal year July 1, 1972, through 
June 30, 1973. 

OBJECTIVH 1 

By ihe end of the two four-week intensive training sessions 
during July and August of 1972 and an academic year (1972-73) inserwice 
training program, 60 teachers from the 21 participating districts will 
be using Environmental Studies (HS) materials through their teaching 
and de^;eloping additional materials and assignments based upon the 
philosophy of the £n^/ironmental Studies program. 
Evaluation Summary of Objective 1 

It was expected that the acceptable level of performance for 
teachers for the first year would be one Environmental Studies assignment 
per week. The average for the 62 participants was 27.8 instea(' of the 
anticipated 36 assignments during the year. 

It was expected that each of the teachers would develop Environ- 
mental Studies assignments which were similar to but not exact duplicates 
of the original En^/ironmental Studies assignments. The acceptable le^cl 
of attainment during the first year was expected to be one e^ery two 
weeks or iS assignments. Instead the average per participant was 34.1 
wliich exceeded the anticipated a'^erage. 

Objocti\/e 1 was ^'ery well satisfied since the teachers progressed 
more rapidly to tlie self-designed l^n^ironmental Studies assignments than 
was anticipated. See Appendix Figure 1 for the details of the number 
of assignments which were achie^'ed by each of the teachers. A tabulation 
of the topics was not received, liowo\.'t2r, in many cases this is a^'ailable 
in Journals wliich are kept by part ic*.i j)a t Lng tcacliers. 

ERLC 
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ODJI-CTIvn 2 

The teacher *s role in relation to the classroom and the students 
will be changed for 60 elementary teachers at the end of the first 
suiiuner session and the academic year of 1972-73. By the end of the 
specified period the teacher and student will have joined in a partner- 
ship in learning through in^^estigation of the environment. The teacher 
will tend to mo^'e to more of an open classroom operation procedure 
and to a class which recognizes that a student may play a more important 
role in the teaching situation. 

£v>-aluat i.ori Summary of Objecti^^e 2 

This e^'aluation is under the guidance of the consultants of the 
Enwiroanental Studies Project at Boulder, Colorado. A copy of this 
evaluation report is attached in the appendix. The report was prepared 
by Robert £. Lepper, Ph.D., Environmental Studies Project, Boulder, 
Colorado. 

Classroom Practices Inventory . It was expected that there would be 
a significant cliange in the results of this inventory to the extent that 
the teacher v;ould be mo^ed to at least one position to the right. In 
the e^^aluation tests using the Classroom Practices Inventory, the pre-«test 
showed an average response on the scale of 1 to 5 as 2.2; the post-test 
average response on the scale of 1 to 5 was 3.5. Therefore, the average 
response was mo--ed to the rigJit to the extent of 1.3 from the pre-test to 
the post-test indicating that there was a change in the classroom 
prac t i ces. 

The Soatinp. Chart Iiir.'ontory was used to indicate whether or not 
the use of Fin^^iroumental Studies materials would affect the physical 
dimensions of the classrooms of the project teachers. It follows if 



the HS ma to rials do foslor more l>|>lmi, fLoxibio class room materials 
then seating ar rangeiiion ts 1 and 7 wuiilcl be more frequently used as 
the year progressed. 

Question No. 1, "Which classroom seating arrangement would you 
be most comfortable in?" showed the greatest change from the pre- to 
post-test to items 1 and 7 indicating a more open type of a classroom. 

Question No. 2, "Which classroom seating arrangement would your 
students be most comfortable in?" showed the greatest change in response 
to items 1 through 7. 

Question No. 3, "Which classroom arrangement do you think your 
principal would prefer?" showed the greatest decrease in response to 
items 3 and 4 and the greatest increase from the pre- to the post-test 
to items 1 and 7, 

Question No. 4, "In which setting do you tliink the students would 
learn the most?" showed the greatest decrease to item 3 and the greatest 
increase from the pre- to the post-test in items 1, 2, and 7. 

Question No. 5, "In which setting would you feel the least 
comfortable?'^ the response between the pre- and the post-test was 
approximately the same with a slight increase to item 6. 

Question No. 6, "Which setting is closest to your present classroom 
seating arrangement?" showed a response which indicated an appreciable 
change in the physical arrangement of the classroom from item 3, which 
is the classical teacher in front of the students in rows of seats, to 
the response of item 1 and 7, whicli is a clustered arrangement or where 
the teacher is in the center of binary uni. ts of students. 

Question No. 7 responses also indicated a movement away fironi the 
classical row type of seating arrangements to tlie more open arrange- 
ments of items 1 and 7. However, there is also a change in items 2 and 



4 which iiidi.cale tho toachor LH'iii<.; a pai't of the ci rciiiar arraiu;cnu;nt 
or the centoi- of a "IJ" arrangenuMil of studeiUs. 

The Scatiiii; Chart I n^'0 u to ry did iiidLcate iiio^'cnient away from tlie 
more traditional classroom sealing organization to the more open 
classroom organization of items 1 and 7. 

Classroom Assessment Cliarr , This instrument should de terniine how 
much of a contribution students and teachers made to the 'MIow, what, 
where, and when'^ of what they studied at the first year in comparison 
to the end of the year. If the ES materials do de^^elop more open 
practices in the classroom where more responsibility is on the students 
and the focus of control of the classroom decisions is on the students, 
there should be a shift as indicated in the instrument. The results were 
recorded as percer^tages of time the classroom was operating as described 
in the four quadrants of the chart. 

The description of the four quadrants from the pre- to the post-test 
is a greater increase to the upper quadrants — the upper left showing more 
active students and passi^/e teacher and the upper right showing active 
teacher and active students. 

The results of the Classroom Assessment Chart are a part of the 
evaluation report as submitted by the Hnvironmental Studies Project, 
Boulder, Colorado. Part 3 of Objecti'^e 2 was achie^/ed as indicated 
by the Classroom Assessment Chart. Two evaluation procedures listed for 
Ob jecti ^/e 1 are also at t r ibuted to the e^^a I nation of Object i^'e 2. They , 
too, indicated that through the use of £n"ironi[iental Studies assignments 
and of P.n^aronmen tul Studies type of assignments that the materials were 
used and s uc c e s s f u 1 1 y . 
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olui-.i:tivh 3 

By the end of the academic year l^>72-73 approximately 1800 students 
will ha^'e learned to use the total. tMP'i rontiient as resource material for 
their education. Their total environment assumes to be the environment 
ranging from the student's immediate ])ersonal surroundings to the extensive 
physical, bioloLjical, and sociolojjiical medium in which he exists, I'or 
this objecti\'e, howe-.-er, concentration will be placed upon the teacher- 
learning env'ironment of the school. 

£\/aluation of Qbjecti>^e 3 

The two tests which were utilized to test this objectiN/e were 

1. The About Me Test . This is a self concept test developed 
by James Parker of Georgia Southern College. There were 
about ten such instruments that the ES staff seriously 
considered using. This test was recei\^?d by students as 
the pre-test trial of the instrument. This instrument was 
administered to the student. 

2. The Posi ti^^e-Negati^^e AdJecti^^e List . This test calls for 
self-description as a means of measuring. The device was 
completed by both the students and the teacher. 

Evaluation Summary of Objecti\re 3 

The About Me Test is a 30 item test with a scale of 1 to 5 for 
each question. Number 1 represents the most positive and Number 5 
represents the least positive feeling about oneself. On the pre-test 
the a.^erage score was 62.2; on the post-test the average was 55.3. 
The results of this test then indicate the mo\'ement of the responses 
toward the Jower numbered side of the scale which indicated that the 
students had a more positi^/e feeling about themscl--es. 

The Positi^'e-Negati-e Adjeclivro List is an instrument to get the 
measure of sel f -conceal t and sel f-<^':-> t erm . The results iiioasured in tlie 
range of the number of poslti\-e and negali\'e adjecti-es as noted by 



10 



the students on tlie test. The pre-tost showed the student's positive 
adjectives as.l.S to 1 negative adjective. In the post-test the 
response was 2.5 to 1. This test also indicated that the students had 
a more positive attitude of themsel^^es . 

NATIONAL EVALUATION SUMMARY 
(ES Newsletter, Spring/Summer 197 3) 

During the past school year ES conducted a study to e^^aluate how 
well ES Packets 1 through 4 were accomplishing their intended goals — 
to increase student decision-makin.;^ in the classroom, to improve students* 
self-concepts, and to de^relop greater awareness in students of the 
workings of their immediate environments. Twenty-two ES teachers in 
three test centers participated in the study, as well as 13 teachers 
picked by participants in the study to act as controls. The grade levels 
represented by the participating teachers ranged from upper elementary 
to lower senior high, with a concentration of teachers at the seventh 
and eighth grade levels. Five instruments were used. (These five 
instruments are the same as the ones used to evaluate the MESA Project.) 

The national evaluation sunmiary would indicate four conclusions: 

1. Students using ES materials learned more content material 

pertaining to their en^'ironment than did the control students. 

2* Use of ES materials fostered en\dronments in which both 
teachers and students made more of their own decisions, 
instead of following plans de^'cloped by others. 

3. ES materials fostered the de^'e Lopment of a more realistic 
self-image or self-concept (indicated by the greater range 

.of results on the "About Me Test" at the end of the year). 

4. Students in ES classes developed a more positive self- 
image or self-concept of themselves than those in classes 
in which ES was not used (indicated by the results of the 
posi tive/negativ*- £ldjecti^re check lists). 



SUMMARY CONCLUSIONS 01- TIIH LiVALUATION 
A suuunariza tioii of the natioual. o\'aliuition of the HS project 
is stated on the foregoing page. The evaluator of the national 
project makes the following conclusions in relating the MESA Project 
to the nationwide project. These statements are as follow. 

During the past two years, the HS project has been carrying out 
an e\'aiuation project '^ery similar to the ewaluation project of the 
MHSA Project. From this work I think two things can be helpful. First 
is essentially corroboration of the findings cited herein. For the 
only differences in the results of the national evaluation is that the 
results are more pronounced in the MESA Project data* That is to say — 
their results are more outstanding than the ES results are in general. 
This I would attribute to the proj.ct staff and the intensive summer 
training programs for the pro*-*t teachers, plus the follow-up throughout 
the year* In addition to the sort of evaluation reported here for the 
MESA Project, the ES e^^aluation project included a look at the content 
that the ES students dealt v/ith as a result of being in classes where 
BS material was used. The question, in part, that was being looked at 
was "If the affecti^^e is ser^;ed will the cognitive follow?" In comparing 
£S students with control students on content analysis the answer to the 
above is YES. For the ES students did Jiave a wider awareness and depth 
of content knowledge of their en'.^ironment . 

The evaluation of the MRSA Project was undertaken to determine whethe 
the project met certain goals. These goals included changes in teacher 
beha^.'ior and student self-concepts. The data reported Jiere gi^es rise 
to the conclusion that those goals were attained. The members of the 
I-ih'ironmenlal Studies staff tluit ha\'C woik^d with Liie ML;SA Project have 



all dc\'C loped tlic same personal e\'aluation of the project. It is that 
they are doing an outstanding job at not only accomplishing- what they 
said they would but also in building a team, including all the teacliers 
and associated administrators, that is functioning at a ^^ery high iev^ei 
in taking \'ery hard and productive looks at the school systems they 
ser<'e* As ES staff we ha^e worked with a large number of school projects 
across the country during the last three years, and we believe this has 
gi\;en us a certain perspecti\/e to e^^aluate projects on. The MESA Project, 
from our ^^antage point, is certainly one of the outstanding ones in the 
country • 



APPIiNDIX I 



Compilations of iaser\^ice ES Acti\^itiei3 
of the Par tic ipa ting Teachers 
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APPENDIX II 



The E^'aluation Report 
of the MHSA Project 
as submitted by 
Robert E. Lepper, Ph.D. 
Enwironmental Studies Project 
Boulder, Colorado 



(This .includes copies of the evaluation instruments used in the MESA Project.) 



ERIC 



R E C ri 1 V ci D 
CCT 1 1973 



Evaluation Penort 

The folloiv'inp materia] is a report on the outcome of the evaluation pro5;ram 
of the MESA pro^^cct In Northeast Missouri « This nroject was designed to facilitate 

the teachers in the project developing and incor)Kn*atinr, Environmental Studies in 

their individual classes* The intent of the evaluation in Part to determine what 

effect the implementation of the EP materials would have on the teachers involved 

and on the studonts'"invol vod in th.e nroiect, The instruments and approaches that 

were used are best understood bv first looVing at the assumptions that undergird 

the EG materials, They follow: 

1, Every student is a reservoir of relevant experience, He is 
an authority about v/hat he has experienced and observed, 

Allov;ing him both intrinsic and extrinsic rewards for drawing upon h\s 
cwi\ experience is a vital step in helping >Lim establish a nositi.ve 
self-image , 

2, The student can make decisions about wiiat happens to him, not 

only among alternatives supplied by others ^ but amonfr alternatives he 
personally created • VHien deci din^^ haf.:(ien . al ternatives created hv 
the curriculum, his nosture is reduced to responding to extrinsic 
obiectives . 

3, The sti'dcnt has a stronr, sense of relevance, Determination of relevance 
is a personal decision that must be made by the. individual. Teachers and 
curricul um.-makers cannot mnlce students, especiallv in the inter-city » accept 
extrinsic notions of i;hat is relevant, 

4, Nothing is more important for the student than to sense and knov; himself. 
Many recent studies shov; that students ^rho l:novT themselves do better than 
students wiio do not. Tiie m.ost important thinr. that each o^ us can 
accomplish in school is to develop a realistic set of aspirations and to 
progress tov:ard ?iis own goals at a rate anT>ropriate to his capacities, 

5, If an atnosplicro of trust; and confidence, detailed bv t]ie above assumptions, 
can be created^ the student wi.ll learn far more capably than we would 
possibly predi.ct , 

The design is a sir.iple pre and post assessment on several instruments. It 
should be noted that no attem.pt v.vis made nor inteiuled to be made to compare teachers 
witli other teachers witliln or witliout of the projoct, ^'atlicr the bias was toward 
looking for grov.-Lh in tho urf^ject teachers toward a i.mre open-flexible approach to 
tfacbinp atul in the effccLr. l])c VS-^ ma f'-- ri a 1 aiid Crirhuds !:rd on students self --concent 



and self-esteem. 
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It also should be noted t!iat the results of all different grade levels are 
lumped together. This is done, for two reasons. T^irsL of all the issumptions 
undcrgirdi.np, the F!S inaLerials are not grade specific, llicy apply at all levels. 
And secondly there is no necessity to factor out by grade, because the results would 
remain tlie same. 

This report will oresent a brief description of each instrument used, followed by 
the data pertaining to that instriir.iGnt and then a discussion of the results will be" 
offered. Additional conmients v/il] be made that come from the national evaluation 
Droiect that v;as carried out by tlie author. The following section is subdivided into 
teacher assessment instruments and student assessment instruments. All instruments are 
in appendix 1 of this mport. 

Teacher Assessment Instruments 

A. Classroom Practices Inventory 

This inventory is composed of 35 stater'cnts pertaining to practices that 
go on in a class room. They vjore develooed hy the author to cet a measure on the 
degree of flexibility and onenncss oneratiug at a given tiire in the classroom. 
The teachers were asked to resj-joiid to tfiese statements in two wavs: Thirst, v/hat 
they are currently practicing and second, V7hat thev v;ould like to do, Since most 
of the statements are descrintions of f lexibl c-oncn t;eaching uractaces, this 
instrun:cnt was used la oet at tv^o things. Did the level of agreement betV7cen 
vliat teachers were doinp and ^;'vat t:iey would like to do increase during the 
scliool year and did r.lie teachers move in the direction of niore f]exlhle classroom 
practices , 

Results: Classroom ^^ractices Invcntorv 
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?re-Test (N=:^R)^> 

7 Ar.roonicnt: hotwcan doing and would 

Agrect^^.ent bctv^ccu 

, 1^ 1 n l^J^G to do: m% 

doing and v;ould like 

to do; 73^ 

* The C*^*s) vary becnusa of random sampling tec))niqucs used, 

The direction of niovomcnt of the j^ro^icct teacliers on the Classroom Practices 
Inventory was determined by connarinc] the relative positions on a scale of 1 to 5 
with 5 representing the more flexible practices and of the contlnum. The data 
comoarod are the pre and post test data in resDoasc to the question "Wiat vou are 
now doing virh respect to tlie s tatcr.icnts, 

Resu] tfj : 
Prc'-Tost 

Averap.e response to55 statencnts on scaje ] to S 
2.2 

Post-test 

Average response t.a?5 statercnts on scale of 1 to 5 
3,5 

B» Seating Chart Inventory 

The .seating chart inventory \;as used to get a fix on whether the use of the 
ES nate vials ;-.'oulcl effect tiie physical dinienf^ions in the classroonis of the 
project teac'p.ers. It fo]lov;s that if the V.S p;.aterials do foster more open-flexibl- 
classroom materials thou scatiii^^ arranrerrcnts J , 7 would he used more frequently 

as the vcar progressed. 
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O teacher 
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Associated v/ith the diagrams were seven questions pertaining to the seating arrangements. 
The seven questions will be listed below and follovinf; eacli question the pre and ■ 
post test results are given. The re.sults are in nercentafes of responses for each 
choice. The N for pre-test is 38 and the N for the post-test is Ifi . 

1. IsTiich classroom seating arrangement wouD.d vou he most comfortable in? 

H"! 2^19 3 '2A 4 .^.8 5 -5 fi ^? 7 -— 7 
Post I-?..?' 2-23 3-18 A-21 5-n f.^ i..^f. 



2, Wrich clnssrooia seating ari.nr.g'^'ment vould your studnnts be most comfortable in? 
Pre 1 --2A 2 -16 3 -6 5 -'-2 7 (^ -1 

Post 1-30 2-3 3-6 Aft 5-25 6-0 7--2S 



3. vrnich classroom seating nrrangemoiu. do you tlrink your principal v.'ould prefer? 
Pre l-'8_ 2^]_2 3_'?)0 A ..'SD 5-o G.-O 7-0 
Post l-'^O 3-l« A-lTs (..J-) y-if', 
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4. In which setting, do you think the students would iGarn the most? 
Pre 1 -6 2 -^6 / r^A 5 -- 6^_0_ 7 - IP 

Post l-?0 2-22 3-S A^16 5-12 ^- n 7-22 



5, In v/hich setting would you ft^cl the least comfortable? 
Pre 1-5 2 -0 " 3-^ A^O S--'!3 7 -11 
Post 1^2 2-1 .V3 /i-O S-.^ fi^^O 7-- 6 



6, IVhich setting is closest to your present classroom seating arrangement? 
Pre 2 ^15 3 --60 A 15 5 -0 -1 7 ->7 

Post J-- 3 A 2 --12 3-^ 7 4-- 19 5-0 Tv-O 7'2S 



7« Indicate what Z of an average month your classes snend in each of the classroom 

seating arrangements shown (it should sdd uo to 3 00%) 

Pre 1-20 2 ^5 3 -60 A ^10 5 ^0 6 - 0 7 -r-5 

Post 1-3A 2-^lA 3 A-2n 5-0 6'-0 7-2A 



C. Classroom Assessment Ch.arts 

The instrument v/as used in a pro and nost test a.ssessmcnt to determine hov; 
much of a contributaon students and teachers made to the how, vhat, where and when of 
what thcv studied at tiie firr';t cf the year in comparison to the end of the vear. If 
the ES materials do develop ror(?*'open*' nrnctlces in the clnssrooiiiS where more 
responsibility is given tiic students then the focur^ of contrtil of classroom 
decisions should shift as indicated in tliis iris trnmcnt • 
Ro.nulls: Classroom Assc^si^r^on t Charts 

The result.^ are rep or tod as nercen Largos of tiv.iO the classroom v;as one rati np; as 
described in t!u'. four quadrants tlic c'^art. Thf^. doj-Tr i pt:i r>ns of the four quadrants 
Q ^e as follov;3: 



I 
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Upper Left Ouadrant 

Active students 
Passive Teacher 



Students 

are active contributors 
to decisions 
regarding the content 
and process of learning. 
Teachers 
have a 

"Hands-Off*' posture. 



*TJbper Ripht Quadrant 

Active Teachers 
Active Students 



Teachers and students 
are active contributors to 
decisions regarding the 
content and process of learning 



Lower Left Ouadrant 

Passive Students 
Passive Teachers 



Students and Teachers 
are directed * 
in their activities 
by district policies 
learning manuals, etc, 



Lover Right Quadrant 

Active Teacher 
Passive Students 



Decisions regarding content 
and orocess of learning are made 
by the teacher. Students are 
receivers not constructors of 
content and urocess. 



Pre-Test . - Post-Test 



10% 




16^/ 


^57 


14" 


30;; 9% 


10 r' 



Student A.ssonsrAent Measures: 
D: Aljcut Mo Test 

Tills insr ri!:-r^nt --/nr^ do\'o]onod !}v .Tnn'.cs Parkor of the Fnivorslty of Heorf^ia, 
. It iHirnosrts to noasurc iun-/ n student f'pcls a^^out. lunsolf in school. This 
Jn:;Lri:i;-?nt var^ s'C'loctcd aff cr <;crPo;': in;: I'orSi dov-Mi iiv.t vvir.oius in a nvo-nse trial. 
It i:': ;.j 30 itcn Lest vith a scale of 1 to ^ for cacfi nut^f'tion, ^;hcre 1 represents 
the most r'ositive and r-.-nrfson i*; ilir- lo/^rC rir-:i.ti\'o fro! i r;bout onoi\ self* 
O lie r;corin); viv. dt/uc bv r.i\K\\]y .'idvli!^^: \\p r!in ::cnri\s v;it:1» 30 ]ieing the niniinum 
ERJCtl't* most positive fepliu.y;) nml 'l!30 tlv^ innx i.riiru mo:;r iw'if'v'it ivo fcL-llngs), 
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Results: 

Pre-Tcst 
(N=38 classes) 

Average Score 
62.2 

Range of Scores 



Post-Test 

(N= 1^ classes) 

Average 
55.3 

Range of Scores 
34-68 



E. Positive-Negative Adjective Check T.ist 

This instruiacnt is another attempt to get a measure of self-concept and self- 
esteem. , The directions to the classes v;ere: M^^ke a list of all of the positive 
adjectives that you can think of that describe you. After that task was corripleted 
the directions were repeated using negative adjectives. The scoring consists of 
counting the positive and neg^ative adjectives for each student and reporting them 
in terms of the ranr^e in the number of each and the ratio of the number of positive 
adjectD.ves to nep^ntive adjectives. 

Results : 

Range in the No. of roijitive and ?Iep.ative Adjectives 
Positive Adjectives ••Jcp.ativc Adjectives 

Pre-test (N= 3^ cla?5Ses) ' ?re--test 

Post-Test CW=16 Clrisses) Post-test 
2-IA 
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Ratio of the Number of Positive Ad.iectlvcs to the number of 



negative adjectives 



Pre-tcst (N=38 classes) 



Post -test (N=l^ classes) 



+ Adj./^^eg• Adj, 



■+Adj ./Neg, Ad.i* 



l.R to 1 



?.5 to 1 



Discussion: 

First some comments on the data preparation and reporting. An attempt has been made 

to make the data easily assimilated by the reader so that any conclusions drawn here 

can be checked out by the reader. Secondly no statistical tests vjere performed on the data. 

The only data manipulations have been in averaging, taking percentages and doing some ratios. 

No further clarity would be found — and indeed prolwiblv less — in this report if 

statistical significance were establislicd for all the differences herein reported. 

The changes in the data from pre to post testing are clearly plain to see and nothing 

else is felt to be needed. 

The results of each test will be briefly discussed and then some summary conclusions offered. 
Classroom Pract i ces Inventor y 

An assumption that must be made in interpreting any measure of this sort is that the 
respondents to the measure responded Iioncstly. In this case there is no reason to 
doubt this assumption and lots of reasons Lo support it. The latter reasons come from 
the interactions of tlie MESA project staff and tlie project teachers* In my personal 
visits to tlio project I observt.:'d nn oiu'iously well-deve] ooed r:n">port and level of 
acccpt:anco on both the st:aff nnd the ter-clior's parts, I run np.lilng this assessment here 
but ii applies to liin wliole of t!ie evnluntion nrrijert as veil as to the project at 



large. 
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From the classroom practices invcMitory two conci ug J.ons fol.l.nv;. They arc that the. 
teachers In the project df-vi grou* tow:ird.? more f.lo:<i.h]o-onen classroom practices during the 
school year and that the teachers vuro nlloKinj; then^.selves to do more of what they 
'Wanted*' to do by the end of the vcnr than thev did at tlie first. In analyr-ing the 
how comes of these results tv;o tliinr.s stnnd out clearly to this person. First of all 
the materials are desLL-^.nod to allcv: teachers as v:ell as students to find out that they 
are more competent than they mip,ht othen-risc thin!:. And secondlv — in observing the 
operation of tlie project in f^eneral t>ie most outstanding^ attribute of the program was 
the operating ethics of accentancc and cooneration. In essence, the orojcct staff 
helped immeusoly in establishing an environment witliin v;hich the project teachers could 
find out what these new cnrricular uialcrials and methods meant to them, thereby 
increasing their own confidence. 
Sea t rnjr, _C_h a rt Inventory 

It was predicted that by urnng the I.S r.nte.rinls tho. physical ch.aracteris tics of the class- 
room would be effected. It v/as furtticr predicted tiiat a higlser percentage of time would 
be spent in the more flexible classroom arrangements as the year went by. Both of these 
predictions are supported by the results. 

It may be that these particular result:; were effected not only by the use of the ES materialr- 
and the' involvement of the project staff but also by this aG.^essment instrument itself! 
For it is little doubted that whon t.he icac^iers sav; tbe insl:ru:':ent for the first time 
the 7 possible seating: arranfAemei-s ts were called tc^ their atUintion* Uowever ,. regardless 
of a sinple or nultJi^le causation it is apparant from the data tliat the teachers moved 
in the direction of more flevi})]e u^e of their pfiysical fac-lities, 

>'iich more: could said a!w--'jt; t]!r;f;e rc-^,ults. lor •'.ri'Uaiice fwrr* v/a-s a large change in 

the teaciier's pt^rception of v.-I-al t!ifir princ1p::ls t: tnf; rhni ci, <; ^/ould ha fro;n the Ijo.^inniri • 

to (.lie ejui of the year. A 3arr,r: cha-ir"- ir: also i ''•'.! on th*-: question of ^^In which 
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.'on If! ! ii ' '"^t 'i.d.MU 
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1 I vcMil annear that th.i s 
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change represents puttinp; more? responsibi] i tv on the students for their learning. 
This of course is one of the goals of the KS materials, 

Clnssro om As ses?^nient Chart 

Fart of the more oDcn-^f legible classroom involvcFi the students being more hit^hly involved 

in the quc^^tions of hov;, v/hat, v:here, and when of their ov.ti studies. The notion 

of course is that if the studcnL.s are part of those decisions then tlie students will la fact 

apply themselves more to the how, x^7hat, when, and wliere of their education. Therefore, 

the classroom assessment chart was used to delenuine vhere the focus of control 

of the decisions in the classroora rested. The data support that at the end of the year 

the students in the project a lot T^iore say in what, went on in the classroom. Certainly one 

of the attributes of the ES material:; is that most all of the assignments are ambigious, 

vhich means that the students vere forced into malting J:2cisions and when a teacher sees 

students fp.aking good decisions lliey pel convincod tliat students are more caDablc al 

making decisions and allou them to do soir.e more of -he time. In the case of the MESA project 

teachers this is v^hat apncars to have taken place. Along with, of course, the MESA projects 

staff innut and encouragc.M-.'ient . 

Abonj: Me Test One of the basic a5:r.ur.:ption5: under] vfng much of the philosophy of the ES 
materials is tliat if the affective is\ served tlien the coj^.nitive will taVe care of 
itse]f. Some data will be prcsento.J as for the cfficiencv of this assumption later, Certain, 
one of the. prime goals of any cdvicnfAonal projf^.ct is to posi.t:ivolv effect the students 
soM~c<»nccpL' or self-esl ec... And in rernc/L: t;ie data f vcn: the About Me Test supports 

vciy strongly that the stuclonts i:cl ^-concept was positively effected during tlie school 
year. One could ea^nUy argt-.o th.:il tlio MESA urojort and the TS> materials had nothing to do 
wj.th this change: by sugr.er.t: ng, t h-j nhsnrved chnTige wouj.d !iave taken p].ace any\;av, llov;- 

evm;, to do so voujd Ijc flying ia l}\c face of an over enlarging body of inf orlI^ation that 
r.ugg.C'SCs that the onpC'Sil*-. vs » true. 'Ilir/i- lh:M going to sriuvol j.s dotrimontal to 




s s(0 f-Cf^r./'cpL not ijnr-: ' i i v»- in ii 



'iiu' M)[-c , ir ;jt)['r.!.-.s i . -a^WMi ai>l to actriiuiLe thi.s 



positive change to the ?0-SA project work. 

And to further soccul.ate, I v;ould hazi-^ard a hard guoss that hy bcinf; around clilldrcn 
vhosc sG].f-concept in school is improving that tlie teachers self-concent also would 
improve, This speculation is of course suniHu^ted (from nv frame of reference*^ by 
the results of all of the neanuvcs' taken on the teachers, "^or if vou aren't feeling 
better al)out yourself it is vorv difficult to loosen the control over 
your environment which of course is what the data supports the teachers did* 

Pes i t i ve-N o jn; a t i ve- Ad jcctive C I leck hist 

The results of tlie positive-negative adjective lists corroborates the results of the 

About Me Test, Both results joing in the samr- direction — that is towards 
a more positive feeling nK-out self. This is particularly 'iniporlant since the About Me 

Test is an instrument tliat constrains and limits the vespondee to a high degree by both its 

format and structure ::hile the adjective lists are inuch mnre like free responses 
manipulated little by formal input or format. 

The N a t i o n a 1 E v a 1 . u a t i. o n Prn.i^ra R 

During the past ?. years, the V.S project haf: hoen carrying, out ah evaluation project 
very siinilar to the evaluation project: of the MFSA proj^'Ct. From Lliis work I think two 
things can he liclnful. Flr^st is or;sontiaIlv corrol-oration of the findin.as cited 
herein. For the only differences in the results of iho. national evaluation is that the 
results are more pi'ononiiccd in iha M:-SA Pro;j.--cl: data, Tbat is to say— their results are 
more outstanding than the KS res\i] t:^ are in genera]. Thin I would attribute to the 
project staff and the intensive su^nner trajninr: nrop.rainri for tiie project teaclicrs, 
pl-us the follov;-ur) throughout: dip year. In ruldilion to th-.' rort of evaluation 
reported hcri: for the project th.f' VS- evalucitlon nroj(*ct included a look at the 

Q nt liiat the VS^ sLu^Irjnls (!e.l t: wi rli as a rosulc of heinr- in cL':ns< ^; v/here VS^ material v;n 
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used. The qiici:.tion, in port, that was bolnj; looked at was **If the affective is served 
will the cogiiiLivc follov/?" In conipar.inp. ES students with control students on 
content analysis the answer to the above is YES. For the ES students did have a v;ider 
awareness and depth of content knov7led.r,e of their environment. 

S u mn» n r v Conclu ^. ioi i n 

The evaluation of tlie MF.SA Project was undertaken to dctormine whether the project met 
certain poals. These goals included chanp,es in teacher behavior and student, self-- 
concepts. The data reportr-d Item f.ivos rise to the conclusion that those c:oals v;ere 
attained. The members of the Environmental Studies staff that have worked with the 
MESA l^roject have all developed the same personal evaluation of the project. It is 
that they are doing an out^rtanding job at not only accomplisliing wliat they said they 
would but also in building a team, including all the touchers and associated administrators, 
that is functioning at a very high level in talcing very liard and oroductive looks at 
the school systems tliey serve. AS ES staff we have worked with a large number of school pro- 
jects across tlie country during the last 3 years and we believe this has given us a certain 
perspective to evaluate projects on. Vao. MESA Projc-ct, from our vantage point, Is 
certainly one of the outstnp.ding ones in the countn'- 
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A. Classroom Prnc tires Inventory 41 

The foilowinp statements are about sonu? ways A. What you are now (loinQ. 
of opcratinj} a classroom. Please rc:^poncl to B. What you would to do. 

each statement under tv;o cnlororios: 

FOR I-AQI STATEMENT c,' n> p m d' a> p ^ ^ 

CIUCLR TIIH 2 MOST APPUOPRIATH POTS l^amrop 

— — ' n O H- tj •< MOrtD^ 

3 H 

1. F.ach student can decide for himself v;hcthcr o 

or not to take part in a particular assignment • . • . , 

2. Each student is allowed to decide hov; he will 

study each topic. 

3. Each student detorniinos how much time he spends 

on a topic. 

4. Students are free to* group as they want. . • 

5. Every student has free access to all the * . . 

materials in the classroonu 

6. Students determine what is removed or added 

to the classroom. 



7. Every student is completely free to move in 
the classroom. 



S. Students freely ask for help whenever they 
need it. 



9. Students are graded on a curve. 



10. Students have the responsibility to evaluate 
themselves. 

11. Students self-initiate their own activities 
whenever they chnor>c. 

12. Each student has his own jiersonal space in 
the classroon (drawers, cupboardii, etc.). 

13. Peer-grou[i teacliiuf^ is ;i primary activity 
in the classroom. 

1-1, Miiny di\^:irsc activities s iiiiul ta;u'Ousl y go 
on in tJic classroom. 

15, Students arc cp.coura^>-d to report on topics 
in any way they want. 

16, Po yon havo contract/- with the student., iii.'iutt 
the: ir lear ni n::? 

17, I am confid(-nt r::y stuldiis wilJ .^\!rn if left 
to t hcins(M, V::.'. . 
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FOR EACH STATrV.HNT 

ciucij- Till- M(vsT APrROPRTA'rn noTs 



18. I leave my students alone in the classroom. 

19. I lower student grades when they make mistakes. 

20. Do I follow a school outline, a manual, or a 
text in pursuing course content? 

21. Students ha've fixed places to sit. 

22. My class is child-centered rather than subject 
centered. 

23. Students can leave the classroom whenever 
they want to. 

24. Students are free to bring anything they 
v/ant into the classroom. 

25. Students are encouiragcd to consult other 
teachers as resource peojile. 

26. I encourage teachers, parents, and adminis- 
trators to come into the cJassrooin as 
resource people and observers. 

27. The operational rules of the classroom, are 
made by students. 

28. Students are free to do nothing. 

29. Individual novel solutions are rewarded 
more tiian cor]ccnsus solutions. 
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30. Students are encouragcci to develop personal 
goals. 

31. I talk individually with studcntr; about tlieir 
personal goals and tlien pursue their dcvelopmejil . . 

32. Student^ arc free to talk to each otlior at any 
t iiiie., ' 

33. Inrlividuals are encour;?i>'d to pursue Iheii* owji 
i. n t c r e s t s . 

34. I like to go to scliool in i\\c: )ac)rjii nr;. 

3.3. Students CLMiri.lor Uieir lolal coinntiuu t. y 
as a priin.n y in-souicc. 
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B. Seating Churt Inventory 44 

These questions concern the diagran^ of classroom seating arrangements shown 
below. For each question, place a mark in front of the seating arrangement 
number which best describes your answer to the question. 



o 



o 



o 

J' 



o o o o o 

G O O O O 

O O O O 

O G O O O 



O C3 o o o 

O G O O O 

o o o □ o 

G C O O O 



c 

CO 



D 



6 



■o 



.o 



□ 



o 

'(I 

i) 



o 

(i 
o 



O CO ^ 
5 

(no teacher) 



□ teacher location 



student location 



L Which classroodi seating arrangement would you be most comfortable in? 
1 2 3 ^ 5 (> 7 

2. V/hich classroom seating arrangement would your students be most comfortable 
• 1 2 3 ^4 5 6 7 

3. Which classroom seating arrangement do you think yoi r principal would 
prefer? 

I 2 3 ^+ 5 6 7 

^. In v/hich setting do you think the students vjoutd learn the most? 
I 2 3 '-^ 5 6 7 



5. In wh ch settir^g would you feel the least comfortable? 
1 3i 5 6 7, 

6. Wh'ch setting is closest to your present classroom seating arrangement? 
1 2 3 5 & 7 _ 



7. Indicate v/hat % of an ^iveiricjc month your cir.sses spend in each of the 
ckissroom seaiinc) a r rarwj^.MUjn t s shown (it should add up to 100%.) 
t 2 3 * 5 6 7 
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12. Abcut Mo Test 48 



Name Date 

Age Teaclior 



School 



A B 0 U T M E 

How a person feels about hiiaself in school scenes to be important to 
how he does in school. Here is a way for you to show how you feel 
about yourself in school. All you have to do is to rate yourself on 
the tliirty items below. You are to choose thie one position that best 
shows how you feel about your$;elf on each line and make a heavy pen- 
cil mark there, like this (1) . Do not mark more than one place on 
any one line. If you change your mind you may erase and nark another 
choice. • There are no ricjht or v;rong answers, and your paper will 
probably be different fro:n anyone else's, jt is best to make up your 
mind quickly so don't spend too nuch tiirto on any itcnr\. There is no 
time limit but most of you should finis]^ in fifteen minutes or less. 
This practice item wil] lie In you underst-imd the job. 

I *m friendly- I'm not so friendly. 

- ( . ) ( ) - ( ) ( ) ( ) 



If you t}unk you are a friendly person ycu should blacken in the 
space to the far Icftf but if you think you are not so fri.endly you 
would place your nark tio tho far riqht. Of course vou m>ay mark anv 
of tho other spocc?j if it cjivos r, ]:)Otter i dt-a of hov; you feci about 
yourself as a friendly pennon. 
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A9 



1 A 






X m nou cjcou in scnoox worK 




1 2 


3 


4 5 


9n 






My ideas are poor 




1 2 


3 


4 5 




J. m a. vv U X c I Uv n 1 i C i> O IT C U 




I 'm not a worthwhile person 




1 2 


3 


4 5 . 


/In 


^ TTi v> V* 4' ^ 1 ^ 4^ 

X in prcT-uy suirony 




I'm not too strong 




1 2 


3 


4 5 




IL'T ^ »^ 1 ^ 4" 1 1 f*» "f" T*^ 

MOSl pSOpJG ciTuS c lu C 




Most people don't trust me 




1 2 


3 


4 5 


OH 


xeatrnGZTjD J.XKG lue pxcLLy wcxx 




1'cachers doii ' t like ine too luuch 




1 2 


3 


4 5 


In 


I can do n\ost. thincjs v.*g11 




I do very few things well 




1 2 


3 


4 5 


8C 


I'm a happy person 




I 'in an unhappy person 




] 2 


3 


4 5 


9D 


I 'm hcaltliy 




I 'm not too healthy 




1 2 


3 


. 4 5 



lOE I 'ra popular 

1 2 



llA I 'ra a good reader 
]. ' ' ' 2 



1213 I'ln a hard v;or}:er 
1 2 



T Mn not too popular 
4 5 



I ^ra not a good reader 
4 5 



I 'm not a hard worker 
4 5 
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13C 


I 'm not shy 




I'm very shy 




1 2 


3 


. 4 5 


14D 


I don't get tired quickly 




I get tired quickly 






3 


4 5 


15E 


other people find me 
interesting 

*» 




I 'm not too interesting to others 




X. z 


-J 




16A 


I work well with others in 
school 




I don't work well v/ith others 
in school 




1 2 


3 


4 5 


17B 


I pretty brave 


• 


I'm not too brave 




1 2 


3 


4 5 


18C 


I 'm pretty smart 




I'm not very smart 




1 2 


3 


4 5 


19D 


I *m tall enough 




I'm not tall enouQh 




1 2 


3 


4 5 


20E 


Most people arc fair v;ith v;e 




Most people are unfair with me 




J. z 


J 


H. D 


21A 


I do well in clciss discus.qicn 




I don't do so well in cJass 
discussion 






•> 

-5 




22B 


I handJ.e most of my problems 


well 


I can't handle my problems 
very well 




1 2 


3 


^ 5 



23C I 'm a helpful t?cJson 
1 2 



I'm not too helpful 
A 5 
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24D 


I 'm good looking 




I'm not too good looking 




1 2 


3 


4 5 


25E 


Most people arc easy for mo to 
got along with 




Most people are hard for me to 
get along with 




1 2 


•3 


4 5 




I'm mostly happy in school 




I'm mostly unhai:>py in school 




1 2 


•5 

J 


4 5 


27B 


I can usually finish what I start 


I never finish most things 




1 2 


3 


4 5 


28C 


I 'm proud of me 




I 'm not proud of me 




1 2 


3 


4 5 


29D 


I handle my body v;el]. in sports 
and- games 




I don't handle my body well in 
sports and games 




1 2 


3 


4 5 


J Oh 


I'm often sorry for others 




I^m not often sorry for others 
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